CONFIDENCE INTERVALS FOR TEST INFORMATION AND RELATIVE EFFICIENCY

Confidence intervals for relative risks.

Heuristic Confidence Intervals for the Gamma Test

The Gamma test is a fast non-parametric algorithm for estimating the noise variance in an input/output dataset modulo the best smooth model. In this short note we communicate a heuristic method for computing confidence intervals for the noise estimate returned by a Gamma test analysis.

Confidence Intervals for the Mutual Information

”THIS PAPER IS ELIGIBLE FOR THE STUDENT PAPER AWARD” By combining a bound on the absolute value of the difference of mutual information between two joint probability distributions with a fixed variational distance, and a bound on the probability of a maximal deviation in variational distance between a true joint probability distribution and an empirical joint probability distribution, confidenc...

Confidence Intervals for Information Retrieval Evaluation

Information retrieval results are currently limited to the publication in which they exist. Significance tests are used to remove the dependence of the evaluation on the query sample, but the findings cannot be transferred to other systems not involved in the test. Confidence intervals for the population parameters provide query independent results and give insight to how each system is expecte...

Confidence Intervals for the Power of Two-Sided Student’s t-test

For the power of two-sided hypothesis testing about the mean of a normal population, we derive a 100(1 − alpha)% confidence interval. Then by using a numerical method we will find a shortest confidence interval and consider some special cases.